Dynamical interplay between local connectivity and global competition 

in a networked population 
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We show, both numerically and analytically, that the consequences of 'wiring up' a competitive pop- 
ulation depend quite dramatically on the interplay between the local connectivity and the global 
resources. With modest global resources, adding small amounts of local connectivity yields an 
increasingly heterogeneous population. With substantial global resources, high-performing yet rea- 
sonably homogenous collective states emerge instead. 
PACS numbers: 02.50.Le, 87.23. Kg, 89.65. Ef, 05.40.2a 



Is 'getting connected' a good or bad thing? How does 
increased access to both global (i.e. public) information 
and local (i.e. private) information, affect both the pop- 
ulation as a whole and its individual members? Thinking 
in terms of future technologies, what are the possible ben- 
efits and dangers of introducing communication channels 
between collections of intelligent devices, microsensors, 
semi- autonomous robots, nanocomputers, and even bi- 
ological micro-organisms such as bacteria [1,2]? These 
questions are relevant to a wide range of computa- 
tional, technological, biological and socio-economic sys- 
tems. However such questions are very difficult to answer 
since these systems are simply 'too complex' [3-7]. 

Here we examine these questions using a minimal 
generic model which mimics a group of selfish, rational 
individuals or components, referred to simply as 'agents'. 
These agents repeatedly compete for a global resource 
by making inductive decisions about future group be- 
havior. The population and its agents may be biological 
(e.g. a population of cellular organisms competing for 
nutrients), computational (e.g. a grid of software mod- 
ules competing for processing time), mechanical (e.g. a 
constellation of sensors or devices competing for commu- 
nications bandwidth or operating power) or social (e.g. 
a population of companies competing for business). Wc 
uncover a rich interplay between the global competition 
for resources and the local inter-agent connectivity. In 
a population with modest resources, low levels of inter- 
connectivity increase the disparity between successful 
and unsuccessful agents. By contrast in a higher-resource 
population with low inter-connectivity, high-performing 
collective states can spontaneously arise in which nearly 
all agents are reasonably successful. At high levels of 
inter-connectivity, the overall population becomes fairer 
(i.e. smaller spread in success-rates) but less efficient 
(i.e. smaller mean success-rate) irrespective of the global 
resource level. 

Our B-A-R (Binary Agent Resource) model is a min- 
imal generic model of a competitive networked popula- 
tion, which is based on Arthur's so-called El Farol Prob- 
lem [4] in which a population of agents repeatedly com- 



pete for a limited resource (i.e. seating in a crowded bar) 
[8] . Despite its everday human setting, the El Farol Prob- 
lem embodies key generic characteristics of Complex Sys- 
tems [4,2]: feedback and adaptation at the macroscopic 
and/or microscopic level, many interacting parts, non- 
stationarity, evolution, coupling with the environment, 
and observed dynamics which depend upon the particular 
realization of the system. Although the El Farol Problem 
is more general than, say, the Minority Game [5,2,6] in 
that it allows for arbitrary levels of global resource and 
is non-binary, the agents still only have access to global 
information. Most biological, informational and socio- 
economic systems have at least some degree of underly- 
ing connectivity among agents [2] leading to exchange of 
local information. It is the resulting interplay of network 
connectivity and competition for global resources that we 
wish to explore and understand. Therefore in contrast to 
previous works [4-6,2] our B-A-R model features network 
connectivity and a general global resource level L. Here 
L, which is not announced to the agents, may represent 
the optimal load capacity of a regional power grid, pub- 
lic utility, or electronic microcircuit; the available space 
in a given urban region, public area or popular bar; the 
data capacity of a given communications link in an infor- 
mational or biological system; the vehicular or passenger 
capacity on a given road or transport system. 

At each timestep t, each agent decides whether to ac- 
cess resource L (i.e. action +1 which might correspond 
to an electronic component or device deciding to draw 
power, a computer sending a data-packet down a given 
route, a surfer accessing a particular website, a com- 
muter taking a given road to work) or not to access 
this resource (i.e. action —1). The two global outcomes 
at each timestep, 'resource over-used' and 'resource not 
over-used', are denoted as '0' and '1'. If the number 
of agents 7i+i[t] choosing action +1 exceeds L (i.e. re- 
source over-used and hence global outcome '0') then the 
n_i[£] abstaining agents win. By contrast if n.+i[i] < L 
(i.e. resource not over-used and hence global outcome 
'1') then these Ji.fi [i] agents win. Each agent decides its 
actions in light of (i) global information which takes the 
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form of the history of the to most recent global outcomes, 
and (ii) local information obtained via network connec- 
tions. Adaptation is introduced by randomly assigning S 
strategies to each agent. Each of the 2 2 possible strate- 
gies is a bitstring of length 2 m defining an action (+1 
or —1) for each of the 2 m possible global outcome his- 
tories. For example, to = 2 has 2 2 = 4 possible global 
outcome histories: 00, 01, 10 and 11. Consequently there 
are 2 2 = 16 possible strategies. Strategies which pre- 
dicted the winning (losing) action at a given timestep, 
are assigned (deducted) one point. At each timestep, 
each agent compares the score of his own best-scoring 
strategy (or strategies) with the highest-scoring strat- 
egy (or strategies) among the agents to whom he is con- 
nected. The agent adopts the action of whichever strat- 
egy is highest-scoring overall, using a coin-toss to break 
any ties. For simplicity we here assume a random net- 
work, where the connection between any two agents ex- 
ists with a probability p. We emphasize that any of the 
above model assumptions can easily be generalized: the 
numerical results are reasonably robust. 

Figure 1 shows the mean success-rate per agent, av- 
eraged over many numerical realizations of the under- 
lying connections and strategy distributions (left axis: 
solid curve) and the success-rate distribution within the 
population for a typical run (right axis: histograms) 
as a function of the inter-connectivity p in a modest- 
resource population. We have chosen L = (N — l)/2, 
which is representative of modest resources since there 
are more losers than winners. We focus on the small m 
or 'crowded' regime [5,7,8] since there are relatively few 
strategies compared to the number of agents and hence 
many agents will simultaneously be competing to win 
with the same strategy. The mean success-rate decreases 
rapidly as p increases (left axis: solid curve) before sat- 
urating at p = p sat <~ 0.1. As m increases, p sat increases 
- full results for the uncrowded, large to regime will be 
discussed elsewhere. The success-rate distribution for a 
typical run (right axis: histogram) at p = exhibits a 
definite 'class structure' in terms of success. Dramatic 
changes then arise as p increases. The spread in the 
success-rate - shown explicitly in the inset and by ver- 
tical arrows in Fig. 1 - indicates a rapid increase in 
the population's heterogeneity in the range < p < 0.02. 
The success-rate distribution becomes almost continuous, 
washing out the p = class structure. Above p ~ 0.02, 
there is a rapid drop in the proportion of highly-successful 
agents. Further increasing p leads to a decrease of the 
spread in success-rates. High levels of inter-connectivity 
therefore provide increased fairness (i.e. small spread in 
success-rate) but decreased efficiency (i.e. small mean 
success-rate). 

Figure 2 compares our analytical results using the 
Crowd- Anticrowd theory [7,8] to the numerical results for 
the mean success-rate per agent. As will be explained in 
more detail elsewhere, the mean success-rate per agent 



can be obtained from the standard deviation of the num- 
ber of agents making a given choice (e.g. +1), by aver- 
aging this quantity over the attractors of the system (i.e. 
averaging over the Eulerian Trail [9] or subsets of it). The 
mean success-rate can hence be expressed [7,8] in terms 
of the mean number or Crowd of agents using the if'th 
highest-scoring strategy (i.e. n^) and the mean number 
or Anticrowd of agents using strategy K which is anti- 
corrclatcd to K (i.e. where ~K = 2 m+1 + 1-K). 

Explicitly 



n K = n K + n^ K - n K - 



(1) 



where Hk is the number of agents who would have used 
strategy K in the absence of the network because of the 
initial random strategy allocation: 



n K = N 
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In short, hk is the intrinsic Crowd-size due to crowd- 
ing in the global strategy space. n^K is a sum over all 
agents who use strategy K as a direct result of a network 
connection: 



J>K 



n.j 



i - (i - P ) nK 



(3) 



Hence n^K represents the increase in Crowd-size due to 
the local connectivity. By contrast, n^^ is a sum over 
all agents who would have used K in the absence of a 
network, but who will now use a better strategy as a 
result of their network connections: 



Uk- 



Uk 



1 - (1 - p )2^g<k ' 



(4) 



Hence uk^ represents the decrease in Crowd-size due to 
the local connectivity. The resulting analytic expressions 
for the mean success-rate are in excellent agreement with 
numerical results (see Fig. 2) implying that the popula- 
tion's dynamical evolution is indeed governed by crowds 
resulting from the interplay between local connectivity 
and global competition. 

Figure 3 shows the mean success-rate per agent (thin 
solid lines) as a function of the inter-connectivity p in 
higher-resource populations, for a range of L values and 
small to. If the global resource level L exceeds a crit- 
ical amount L crit = 3N/4, the mean success-rate per 
agent can exhibit a maximum at small but finite inter- 
connectivity, for the following reason. When L > L crit 
and p = 0, the population inhabits a 'frozen' state in 
the sense that the global outcome is persistently 1, i.e. 
. . . 111111. With S — 2 as in Fig. 3, each agent has prob- 
ability 1/4 of being assigned two strategies which both 
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define action —1 following a string of m 'l's. Thus ap- 
proximately 1/4 of the population always lose and 3/4 of 
the population always win, leading to L crit = 3iV/4 w 75. 
The global resource is therefore under-used at p = by 
AL w (L — 3-/V/4) at each timestep. Therefore increasing 
p away from p = will benefit some of the less success- 
ful agents by connecting them up to successful agents, 
thereby giving them access to AL, until a p value is 
reached where the connectivity is sufficient to break the 
outcome series of l's. These run-averaged results can be 
better understood by considering run-specific results for 
L = 100 as an illustrative case (scattered circles). Spe- 
cific runs appear to aggregate into groups having simi- 
lar temporal dynamics and success-rate distributions - 
these groups correspond to different dynamical states of 
the system. The increase in the mean success-rate at low 
p, corresponds to the system following an Efficient State 
E which has an outcome series of l's as discussed above. 
The success-rate distribution in State E (inset) is char- 
acterized by groups of persistent winners and losers. As 
p increases further, the outcome series for high L tends 
to move through a set of Intermediate States which com- 
bine a low spread in success-rate with a high mean (e.g. 
Intermediate States A and B). In Intermediate State A, 
the least-successful agents (which in State E had zero 
success) now have a success-rate which exceeds the av- 
erage success-rate in the high connectivity limit. In the 
high p limit, the outcome series tends toward the period- 
4 Eulerian Trail [9] given by . . . 00110011 . . .. The cor- 
responding number of agents taking action +1 follows 
the pattern ...N,N, N/2, N/2, N, N, N/2, N/2 . . .. The 
resulting Fair State F corresponds to all agents having 
access to the best performing strategies, either by being 
assigned that strategy or by being connected to another 
agent with that strategy. The resulting system is fair but 
inefficient, having a small spread but also a small mean 
success-rate « 0.25. 

Figure 4 shows the mean success-rate per agent (thin 
solid lines) as a function of the inter-connectivity p in a 
high-resource population (L — 95) for various history bit- 
string lengths m. The Intermediate States, characterized 
by a reasonably high mean success-rate and a reasonably 
small spread (see Fig. 3 inset), have an increasingly dom- 
inant effect on the system's behavior as m increases. For 
a particular value of m, increasing p moves the system to- 
ward cycles of increasing period and hence the fractions 
of l's and 0's in the output series become more equal. 
The resulting State F, which represents an increasingly 
noisy version of the Eulerian Trail as m increases, is fair 
but inefficient (see Fig. 3 inset). 

We have derived analytic expressions (thick solid lines 
in Figs. 3 and 4) which describe well the three dynamical 
regimes exhibited by the numerical results. The upper 
analytic branch at lowp, describing the efficient State E, 
is given by: 



d-vY 



(5) 



The middle analytic branch at intermediate p, describing 
the Intermediate States, is given by: 

3 9 . , 71V 1 , , 15JV 1, . 3N . . 

i -^(l-p)^-^(l-p)^ r + g(l-p) T • (6) 

The lower analytic branch at high p, describing the fair 
State F, is given by: 

1 9 . ■ 7N 1 . , 15JV 1 . ■ 3N 

- H (1 - p) 16 H (1 - p) 16 H (1 - p) 4 • 

4 128 1 U 128 V y> 16 V ' 

(7) 

The outcome series of l's at low p which yield State E, 
can persist up to p crit - 1 - (1 - 4AL/N) ' 4 / 3N . For L = 
80,90,95 and 100, this yields p crit ~ 0.002,0.011,0.019 
and 0.042 respectively, which are also all in excellent 
agreement with the numerical results. A full analysis of 
the dynamics of, and switching between, these regimes 
will be given elsewhere. 

In conclusion, we have reported a rich dynamical inter- 
play between local connectivity and global competition in 
a generic networked population. Apart from the intrinsic 
interest regarding functionality in complex system net- 
works, our results suggest that the internal connectivity 
and global resources in such systems can be engineered 
in order to enhance performance. 
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FIG. 1. Modest resource population: Solid line (left axis) shows numerically-obtained mean success-rate per agent, as a 
function of the probability p that agent i is connected to agent j. Right axis: typical histograms of agents' success-rate in a 
typical run of 10 5 timesteps. N = 101, S = 2, m = 1 and L = 50. Inset: spread in success-rate as a function of p. Error bars 
obtained from 20 separate runs. 
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FIG. 2. Solid lines show analytic Crowd- Anticrowd theory for mean success-rate per agent in a modest resource population, 
for S = 1, 2, 3, 4. Data-points are numerical results, m = 1, N = 101, L = 50. Inset: S = 2, various N values. Right: Eulerian 
Trails [9] (i.e. high p attractor) for m = 1,2, 3. 
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FIG. 3. Higher-resource population: Thin solid lines: numerically-obtained mean success-rate per agent as a function of p, 
at resource levels L — 80, 90, 95, 100. Results averaged over 200 runs of 10 5 timesteps, with iV = 101, S = 2, m = 1. Scattered 
circles show mean success-rate per agent for separate runs at L = 100 with m = 1, as an illustration. Thick solid lines: 
analytical curves (Eqs. (5)-(7)) describing the three dynamical regimes. The results agree so well over some portions, that the 
analytical curves obscure the numerical results. Inset: histograms of typical success-rate distribution, for L — 100, m = 1. 
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FIG. 4. High-resource population: Thin solid lines: numerically-obtained mean success-rate per agent as a function of p, 
at various m. Results averaged over 200 runs of 10 5 timesteps, with N = 101, S = 2, L = 95. Scattered circles show mean 
success-rate per agent for separate runs at m = 3. Thick solid lines: analytical curves (Eqs. (5)-(7)) describing the three 
dynamical regimes. The results agree so well over some portions, that the analytical curves obscure the numerical results. 
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